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Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH{S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 
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1 )S Responsive to connmunication(s) filed on 1 7 September 2004 , 
2a)S This action is FINAL. 2b)n This action is non-final. 

3) \3 Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 
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4) S Claim(s) 12 and 14-33 is/are pending in the application. 

4a) Of the above claim{s) is/are withdrawn from consideration. 

5) n Claim(s) is/are allowed. 

6) ^ Claim(s) 12, 14-33 is/are rejected. 

Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) 0 The specification is objected to by the Examiner. 

10)D The drawing(s) filed on is/are: a)D accepted or b)^ objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 

Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 
11 )□ The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 
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DETAILED ACTION 
Remarks 

1. Claims 1-11 and 13 were canceled. New claims 23-33 are added. Pending claims are 12, 
and 14-33. 

Response to Arguments 

2. Applicant's arguments with respect to claims 12, and 14-33 have been considered but are 
moot in view of the new ground(s) of rejection (with the revised action in response to each newly 
amended and new claims). 

Claim Rejections - 35 USQ 102 

3. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless — 

(b) the invention was patented or described in a printed publication in this or a foreign 
country or in public use or on sale in this country, more than one year prior to the date of 
application for patent in the United States, 

4. Claims 12, and 14-33 are rejected under 35 U.S.C. 102(b) as being anticipated by Hoffert 
et al. (U.S. Patent No. 5,903,892/ or "Hoffert" hereinafter). 

Regarding claim 12, Hoffert discloses "a method of browsing a video using information 
on semantic relations between segments of a multimedia stream characterized by a video 
browsing interface including a video display view and a key frame or a key region view, the 
method comprising: displaying the information on associate meanings between segments by the 
video browsing interface further including key fi-ames or key regions or text for displaying 
information on semantic relations between the segments; and performing a video browsing by 
using key frames or key regions or text displaying the information on semantic relations between 
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segments", i.e., a media index is creating based on predetemiined semantic relations or context 
relations between segments using the contents of the multimedia stream for the constructing 
information occurred (see Figs. 2B & 2C, and col. 6/lines 20-55 & col. 7/line 1 1 for the contents 
of video and audio based on content attributes of media objects and associate relevant data; and 
Figs. 4A & 4B for performing a video browsing by using key frames or key regions or text 
displaying the information on associate meanings between segments). In addition, Hoffert 
discloses "wherein the information on semantic relations between segments is an information on 
cause/effect or abstract/detail relationship", i.e., semantic relations between segments regarding 
as context relations between segments are disclosed by Hoffert as Hoffert shows a plurality of 
attributes on cause/effect or on abstract/detail (context relations between segments) as relevant 
lexical content information related to media file for the user to have a meaningful database to 
search (col. 4/line 52 to col. 5/line 42 & col. 6/lines 20-46: and col. 7/line 52 to col. 8/line 8 for 
each data object with content relations based on a plurality of attributes). 
(Claim 13 is canceled). 

As for claim 14, in further view of claim 12, Hoffert discloses "wherein a user can select 
a case as to whether to shift to a frame corresponding to the selection region or to a segment 
represented by the selected region, or to a cause segment of the corresponding segment or to an 
effect segment or to an abstract segment or to a result segment, if the user selects a 
predetermined display region of the key frame or the key region view" (Figs. 4A & 4B for 
performing a video browsing by using key frames or key regions or text displaying the 
information on associate meanings between segments on any segments selected by the user, see 
more details on col. 21/line 55 to col. 24/line 13). 
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As for claims 15 and 17, in further view of claim 12, Hoffert further suggests "wherein 
each segment is expressed by a node, and the relationship between the segments is expressed by 
a link in a region displaying the information on semantic relations between segments" and 
"wherein the corresponding node and the link are displayed in a graphic structure in the region 
displaying the information on semantic relations between segments" (Fig. 3 A as attribute 
segments as nodes are linked together based on their relationship as a link in a graphic structure 
as stated). 

As for claim 16, in further view of claim 15, Hoffert shows "wherein each node is 
expressed by using the key fi-ame, the key region or a text in the region displaying the 
information on semantic relations between segments" (Figs. 4A & 4B for performing a video 
browsing by using key frames or key regions or text displaying the information on associate 
meanings between segments on any segments selected by the user, see more details on col. 
21/line 55 to col. 24/line 13). 

As for claim 18, in further view of claim 15, Hoffert shows "wherein the corresponding 
node and the link are displayed in a tree structure in the region displaying the information on 
semantic relations between segments" (attribute segments as nodes are linked together based on 
their semantic relationship as a link in a tree structure as in col. 7/lines 28 to col. 8/line 1 1 for a 
database with attributes are linked together based on tags, indexing, keywords, textual 
annotations, text strings etc). 

As for claim 19, in further view of claim 15, Hoffert suggests "wherein the corresponding 
node and the link are displayed in other structures than the graphic structure or the tree structure 
in the region displaying the information on semantic relations between segments, the 
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corresponding segment and the segments related to the associate meanings being dynamically 
converted and displayed when a predetermined segment is selected", i.e., URL structure, HTML 
structure, a Java script structure, or tables, or lists and other structures are used for representing 
the semantic relations between segments, see col. 4/lines 31 to col. 5/line 29). 

As for claims 20-22, in further view of claim 15, these claims for the steps of "wherein a 
shift is made to a corresponding segment if each node of a graphic view of information on 
associate meanings is selected"; "wherein the region displaying the information on associate 
meanings displays the region displaying the information on associate meanings between 
segments centering around a segment currently being displayed"; and "wherein the graphic view 
of information on associate meanings selects a plurality of nodes, and the segments 
corresponding to the more than one selected node are automatically linked and reproduced" are 
rejected for the reasons given in the scope of combined claims 12, 14-17 as discussed above. 

Regarding claim 23, Hoffert discloses "a method of describing information on relations 
between segments of a multimedia stream", i.e., indexing is used as a method of constructing and 
describing information for video and audio segments with their semantic relations or context 
relations of a multimedia stream (col. 6/line 18 to col. 7/line 26, and fiirther on col. 1 4/lines 30- 
62 for audio segments and col. 21/lines 55-65 for video segments), comprising "describing 
information on semantic relations between segments including segment locators and description 
of cause and effect semantic relationships between said located^e^OTts based on contents of 
said located segments", i.e., a plurality of attributes on cause/effect or on abstract/detail (context 
relations between segments) as relevant lexical content information related to media file for the 
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user to have a meaningful database to search (col. 5/lines 1-29 & col. 6/lines 20-46 & col. 7/line 
52 to col. 8/line 8). 

As for claim 24, in further view of claim 23, Hoffert further discloses "wherein the 
segment locator is an information on intervals" (as shown in Figs. 3E & 3H, information 
intervals are used as segment locators; and tags for video segments are regarding as information 
intervals for predetermined video segments, see more on col. 21/lines 61-65, col. 22/line 62 -col. 
23/line 17). 

As for claim 25, in further view of claim 24, Hoffert discloses "wherein the segment 
locator further comprises information on a stream" (col. 6/lines 20-55 for information is stored 
on a stream of segments or in a portion of the media file). 

As for claim 26, in further view of claim 25, Hoffert suggests "wherein the information 
on a stream is an information on relative/absolute locations of the stream" (col. 20/line 44-col. 
21/line 28 since the locations of fi*ames is determined by a formula with number of frames in 
N>=0 or integer numbers, for instance, the user can select a segment from Frame 15 to Frame 
80; therefore, the information on relative/absolute locations of the stream can be determined). 

As for claim 27, in further view of claim 25, Hoffert discloses "wherein the information 
on a stream comprises a unique identifier (ID) for the stream" (col. 6/line 56-col. 7/line 25 as the 
indexing technique of video and audio files for identifying or locating segments or portions of 
audio/video files; and col. 25/lines 39-61 for media track IDs). 

As for claims 28 and 29, in further view of claim 24, Hoffert discloses "wherein the 
information on intervals is described as a startmg point and an ending point of the segments" and 
"wherein the information on intervals is described as information on a starting point and a length 
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of the segments", i.e., length and time of the video segments is calculated for a number of frames 
or an information interval representing a starting frame and an ending frame from N=l to N 
(integer) frames in a predetermined timeframe T (col. 20/line 44-col. 21/line 28). 

As for claim 30, in further view of claim 23, Hoffert discloses further "comprising 
information on an additional weight value with respect to the cause/effect relationship between 
the segments so as to order the segments affecting a particular segment or the segments affected 
by a particular segment" (col. 7/lines 27-51 for additional weight values addressed). 

As for claims 31-33, these claims, with same limitations addressed earlier, for a data 
structure for describing information on relations between segments of a multimedia stream are 
rejected for the reasons given in the scope of claims 23-26 and 30 as discussed in details above. 

Conclusion 

5. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. 
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6. 



Any response to this action should be mailed to: 



Commissioner of Patents and Trademarks 
Washington, D.C. 20231 



or faxed to: 



(703) 872-9306, (for Technology Center 2600 only) 



7. Any inquiry concerning this communication or earlier conraiunications from the examiner 
should be directed to Krista Kieu-Oanh Bui whose telephone number is (703) 305-0095. The 
examiner can normally be reached on Monday-Friday from 9:00 AM to 6:30 PM, with alternate 
Fridays off. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Christopher Grant, can be reached on (703) 305-4755. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to Technology Center 2600 Customer Service Office whose telephone number 
is (703) 306-0377. 



Krista Bui 
Art Unit 2611 
February 11,2005 




